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^  Abstract 

Each  member  of  a  team  of  decision  agents  receives  a  conditionally 
independent  observation  about  some  underlying  discrete  hypothesis.  Subject 
to  causality  constraints,  the  agents  seek  to  optimize  a  team  cost  functional 
by  making  discrete  decisions  which  are  conveyed  to  other  agents  on  capacity 
constrained  channels.  This  paper  derives  optimal  decision  rules  for  a 
class  of  problems  of  this  type  and  discusses  their  properties. 
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I. Introduction 

Purpose;  Team  theory  has  long  sought  to  unify  the  joint  estimation/ 
communication/  control  problems  that  arise  when  several  agents  that  receive 
different  information  attempt  to  cooperate  [2].  These  problems  have 
proven  to  be  rather  difficult  in  many  cases  [11],  although  a  suprising 
number  of  them  can  be  reduced  to  an  equivalent  static  framework  [3,4] 
through  reformulation. 

Building  on  [8],  this  paper  describes  the  solution  of 
a  number  of  specific  team  problems  with  non-partially  nested  (non-NP) 
information  structures.  The  problem  is  made  tractable  by  assuming  that  the 
underlying  natural  randomness  takes  the  form  of  a  fixed,  discrete 
hypothesis  and  that  the  decision  agents  receive  conditionally  independent 
observations.  This  permits  explicit  computation  of  decision  rules, 
even  when  communication  (preassigned  flow  pattern)  is  allowed  between 
agents.  The  decision  rules  themselves  display  an  interesting  structure 
which  aids  interpretation  of  the  solution  (e.g.  in  terms  of  an  optimal 
quantization  of  the  local  information) .  The  insight  gained  from  this 
work  will  serve  as  a  stepping-stone  for  the  development  of  a  general 
solution  procedure  for  distributed  hypothesis  testing  with  communication 


constraints. 

Related  Work:  As  the  logical  sequel  to  [8],  Sections  2  and  3  present  results 
for  two  special  classes  of  structures:  tandem  and  hierarchical.  The 
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problems  discussed  are  endowed  with  digital  communication  links  between 
the  decision-makers  (DMs) .  A  predetermined  causal  precedence  ordering 
is  imposed  as  each  DM  needs  the  decisions  of  his  predecessors  before 
it  can  generate  its  own  decision.  We  retain  however,  the  assumption  that 
the  actions  of  the  DM s  do  not  in  any  way  affect  any  system  dynamics. 

However,  unlike  problems  with  predetermined  communication  variables 
(e.g.  one-step  delay  information  sharing  [7],  [5]  and  [10]],  the  communicated 
variables  are  limited  to  m  discrete  values  with  their  content  to  be 
determined.  Messages  are  conveyed  error  free,  i.e.  we  do  not  consider 
noisy  channels  [1],  although  generalizations  to  this  case  can  readily 
be  drawn.  While  the  m  discrete  value  channels  provide  encoding  capability, 
we  are  not  interested  in  coding  per  se  [1]  but  rather  seek  the  overall 
optimal  communication  and  decision  strategy.  Note  that  this  allows  explicit 
signalling  [9]  from  a  DM  to  f,downstreamM  DMs  through  the  communication 
links. 

Problem  Statement:  Find  tj  •  “*ty)if£o,l, . . .  ,nJ  ,  to  minimize 

. X* )  *  e{j(uq,H)}  where  uq  is  the  output  of  the  detection 

network;  {u( ,u^, . . . are  internal  communication  variables;  and  is 
the  information  available  to  DMi  as  specified  by  its  access  to:  (1)  a 
local  observation  y  and  (2)  other  decisions  specified  by  the  topology 
of  the  communication  network  (Figure  1) .  Finally  H  is  the  underlying 
discrete  state  of  nature. 

Overview  of  results:  Solutions  are  available  for  binary  problems  where 
H€[h°,H^J  and  and  a  number  of  network  topologies.  Extensions  to 


M-ary  hypotheses  and  m^  symbol  channels  are  straightforward  and  discussed 
in  Sections  2  and  3. 

II. Tandem  Team  Configuration 

Assumptions:  The  tandem  network  topology  is  illustrated  in  Figure  2.  H° 
and  arise  with  known  a  priori  probabilities 

P(H°)  -  P°  P(HX)  -  P1  (1) 

The  joint  conditional  observation  distribution  is 

P(y0,yi/Hj)  for  j€{0,l}  (2) 

where  the  subscripts  denote  the  DM.  (The  y^'s  may  be  random  vectors  generated 
by  "preprocessing"  of  the  original  measurements) .  The  global  cost  function  is 
defined  by  J(uq,H)  where 

J  :  lo.llxjH^H1}  1R  (3) 

The  objective  of  the  team  is  to  minimize 

e{j(u°,H)}  (4) 

and  we  will  interpret 

H°  is  declared 

(5) 

is  declared 


The  following  assumptions  simplify  in  the  derivation  of  the 


Phenomenon  E 


2:  Two  DM  Tandem  Topology 


J 
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decision  rules: 

Assumption  1:  The  observations  yQ  and  y^  are  statistically  independent, 
i.e. 


p(yi/y0»H)  •  pCyj^/H) 

p(yo/y1,H)  -  p(yo/H) 


(6) 


(See  [6]  for  a  case  of  dependent  measurements  without  communication). 
Assumption  2; 

(a)  J(1,H°)  >  J(0,H°)  1  (7) 

as  per  the  interpretation  of  J 

(b)  p(uo“0/uj»0,y^)  ^  p(uo«0/u1“l,yo)  (8) 

this  disambiguates  two  possible  symmetric  solutions 


Derivation:  We  begin  with 
Lemma  1: 

2^J(u  . 


Hw)[p(uo/uj-0,y1)  -  p(u£>/u1-l,yo)]  <0 


Proof :  Expanding  expression  (9) 


J(0,Ho)p(u(>-0/u1»0,y0)  +  J(l,Ho)p(uo«l/u1«0,yo) 
-J(0,H°)p(u(j"0/u1*l,yo)  -  J(l,H°)p(uo-l/u1-l,yo) 

But 

p (uq»1/ u^“0 , y  )  -  1  -  p(uQ»0/u1-0,yo) 
p(u  «l/u.«l,y  )  ■  1  -  p(uo»0/u1-l,yQ) 


(9) 


(10) 


(11) 


Substituting  (11)  into  (10)  and  simplifying 


(J(0,H°)  -  J (1,H°) ]  | P (uo*0 / u1*0 , yQ) 


p(uo»0/u1-l,yo)j  (12) 


and  Assumption  2  gives  expression  (12)  is  less  than  0. 

This  lemma  is  required  for  proving: 

Theorem  1:  The  decision  rule  for  DM0  (Figure  2)  is  given  by 


Q.E.D. 


U0  *  To(y0,ut) 


(13) 


and  *»(.)  is  ehe  following  likelihood  ratio  test: 

•  i  Klein*)  >  P(U')P(u,/h‘)[J(0.h')-7o,H‘)]  (m) 

94  p(%/H')  <  p(  H°)  p  (u,  I  Na)[-J (t,  H*)  -  J(0,  *•)] 


//  u /  »o 

if  <s.*f 


(ts) 


The  objective 


min  E  { J(uq,H)} 


is  expanded  explicitly  as: 


Y?  jp(u;  n)Jyo  jy, 

y,,y'  *£  [ntipW**-'*" »)P<u»w> M7**' *)J» Jr> 

Invoking  appropriate  independence  assumptions  yields 

£  j P(H)  f>(u.ld„  1o)f>(u,,y,  Mp(lolH)-T(uoi  H)  ttyo  c/.y , 


*•  v»*v/ 


'  >»#  T/ 

Explicitly  summing  over  u^  and  ignoring  constant  term,  the  expression  to 


be  minimized  reduces  to 


£  jp(u**o/u„t ’»)  ^2  f p(»)f>(ylMilH) p(y0/u)[ J(o,h) -  JO,  #)]c/y0 o!yt  (^Z) 

*  H  y , 


This  expression  is  minimized  by  setting 

(  O  '/  '£*P(H)f(u'W)p(  iolH)[j(o,H)  -J(t,  H)]>0 

p(u0^o/u,tya)  =  J  H 

(  /  o  /^e 

Expanding  over  H  and  invoking  Assumption  2(a)  yields  the  decision  rule 


Cu) 


for  DMO  given  in  expression  (14) . 
For  Vf(.)  ,  write  (21)  as 


2  f  P(n)p(uc/u,,y*)  p(u,/yt)  p(y,to)p(yM  '?(U;H)dyo  dy, 


(14) 


W  J 

"•  fait 


Explicitly  summing  over  u^,  substituting  p(Uj«l/y^)  -  1  -  p^-O/y^) 
and  ignoring  the  constant  term  yields 

f />(«„./»,)  £  / (is) 

Jsm  U.  ZiL  At 


yy,  M&m  1* 

The  expression  is  minimized  for 
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(  0  '/  £ 

piur-ofy*)  *  j  u,Uo 

V  /  oilntrojise 

Expanding  over  H  and  Invoking  Lemma  1  yields  Che  decision  rule  for 
mi  given  in  expression  (17).  Q.E.D. 

Summary:  The  person-by-person  optimal  decision  structure  is  based  on 
three  thresholds  that  must  be  calculated  together: 


y“  «*> 


h  ■  Ei0ro(-» 

eo°  * 

I  *** 

A  _  c  f  f  \  \  / 


(27) 


where  f^(.)  and  fQ(.)  are  defined  in  expressions  (14)  and  (17).  The 
simultaneous  solution  of  these  equations  yields  the  three  thresholds. 
Extensions : 

Theorem  2:  For  the  tertiary  hypothesis  case,  i.e.  HC^H°,h\  and 
tertiary  symbol  channel  capacity,  i.e.  u^  ^0,1,2}  ,  i«[o,l],  the 
decision  rules  for  DM0  (Figure  2)  is  given  by 


(Jo  -  Yo(y.0t  u») 


08) 


and  Ya(*)  is  the  following  set  of  likelihood  ratio  tests: 

Uo*  i  Ork 

•  «  ^  s  P(nk)p(«t (X H kK  Ta, 

for  (i,j,k)<  J (0,1, 2), (0,2,1), (1,2,0)} 


The  decision  rule  for  DM1  is 
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u,  =  ^/(y/) 


(3o) 


and  Til)  is  given  by  the  following  set  of  likelihood  ratio  test: 

A!  t  ^2  >  £ ad d d-dxd ija  + 

r  1  rj/) 

for  (i, j ,k) €  { (0,1, 2), (0,2,1), (1.2,0)] 


•**  y«#y, 


Proof :  Consider  expression  (20) 

52  I  P(H)pi^o  lt*<>  y*)f(u,,  y,  In) H  )Jyc  <Jy, 

>“•  l  yt 

=  51 j  F(^o(u, ,  y0)  52  ft") f>(*>  !h) ft)  Jyo 

Hence  the  decision  rule  is  deterministic  and  is  given  by  (29) . 

To  show  (31)  rewrite  (32)  as 

/  Y*p(u»h>)  52  tid*, 

«Y,  ul  H)<Jo  V 

and  parallel  the  proof  of  Theorem  1.  Q.E.D. 

Theorem  3:  For  the  Three  Tandem  DM  case  (Figure  3)  and  binary  symbol 

capacity  channels,  the  decision  rule  for  DM0  is  biven  by 

u0  =  Zo  (yo,i{/) 

and  T»(*)is  the  following  likelihood  ratio  test: 

Uo*0 

^  a  P(yo/H°)  ^ 

"  ’  P(yoiH')  <  P(H°) p(u,  /H °) [  J( I , 


u0-./ 


U' 


if  u,:o 

if  u,  -  i 


(32 


(**) 


(2*t) 


(ss) 


(2b) 
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Figure  3:  Three  DM  Tandem  Topology 


The  decision  rule  for  DMi  (if|l,2^)  is 

Uj  ~  “Vi  (y^ )  i  c  1 1 >  • 


and  TfiCO  is  the  following  likelihood  ratio  test: 

y;-zQ 

;  Pfsj.luo)  >  5Z  P(U  rt')lf( 1,0 /“I*  0*  Y‘)  -ptUofar-  h  Yo)J 


P(y/i)n')  <  2  ft  h°)  '?(u0,rt")[p(u°lL,i  s6  'ic)-f>(uolu;-o/  ya)l 

Uist  a0  J 


Proof:  This  proof  parallels  the  one  in  Theorem  1. 


Q.E.D. 


Extensions :  Consider  DMl  in  the  tree  structure  illustrate  in  Figure  5. 

Assume  the  pair  of  decision  rules  in  DM4  and  DM0  are  fixed.  Then  a  cost 
function  of  and  H  at  DMl,  J(u^,H),  can  be  obtained  by  taking  the 
expectation  over  yQ  and  y^,  i.e. 

-T(u„ h)*E  I  <r<Uo‘  I  Y*(’ 1  ’  r°('} } 

Yo,W 

Given  this  cost,  one  can  solve  for  decision  rules  7/,3i  and  Ifj  using 

Theorem  4.  Inserting  these  decision  rules  into  the  the  DMs,  one  can 

compute  p(u^/H).  Then  one  can  solve  for  the  decision  rules  for  DM0 

and  DM4  with  u^  (described  by  p(u^/H))  by  using  the  results  from  the 

tandem  case  (Theorem  1) .  Mote  that  u^  acts  as  an  additional  measurement 

to  DM0.  The  result  of  this  process  is  an  iterative  procedure  for  alternately 

computing  £*11, V*!’ and  ^  which  exploits  a  decomposition 

resulting  from  the  Independence  of  observations  when  conditioned  on 

H  (Assumption  1) .  This  suggests  a  procedure  for  extending  the  results  for  these 

simple  cases  to  larger  networks. 
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IV. Summary 

Optimal  decision  rules  for  a  static  non-PN  detection  team  have 
been  derived.  The  decision  rules  are  likelihood  ratios  in  the  actual 
data,  with  thresholds  determined  by  incoming  communicated  messages.  The 
number  of  thresholds  at  each  DM  is  equal  to  the  number  of  combinations 
of  these  discrete  inputs .  Moreover,  it  is  apparent  that,  at  least  for 
some  tree  structured  problems,  a  decomposition  principle  (along  the 
lines  of  spatial  dynamic  programming)  can  be  found  for  methodically 
computing  decision  rules.  This  is  a  topic  of  current  research  and  will 
be  reported  in  a  subsequent  paper. 
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